S3Drive - General bug reports

Hello! First of all, I want to advise you that I bought the ultimate license to support your work!

I did some test in these days, I report you. Linux Mint 20.3 - S3 drive Ultimate plan license 1) Problem with linux app installation, only working method is flatpack way 2) Files that I'm uploading doesn't appaer in the bucket, how is possible? At the same time even if I upload a file directly to the bucket I can't see it on s3 drive. So.. Where files are stored?

3) I'm not able to upload a large file (~800mb) from web app neither from linux app - "XmlTagException: Expected </hr>, but found </body> at 6:1" 4) From linux app I can't enable mount - FUSE error, but I installed the libfuse2 package 5) From linux app from "+" button -> add files I have upload stuck, instead from drag and drop it works 6) Sync function with 2way mode works with s3 storage? 7) Not properly an error - When I retry the file upload, file still remaining on error stage, I think it shold return to progress stage (edited)

Thanks for your report and supporting the project ! What's your provider? Is it external S3 or our testing account, please note that today we've released major improvements to testing accounts, so they work faster and more reliably. Regarding 2) How do you upload files that doesn't appear? Through S3Drive UI, mount or sync? Regarding 3) What's your browser? I am going to review your other points and get back to you.

1) I'm using Cubbit provider.. which are testing account? I can use it? Btw I'm using my s3 provider as testing account at the moment. 2) It's the same, s3 linux app (flatpack) and for browser 3) Google Chrome 123.0.6312.105 (edited)

Riccardo Bellanova

1) I'm using Cubbit provider.. which are testing account? I can use it? Btw I'm using my s3 provider as testing account at the moment. 2) It's the same, s3 linux app (flatpack) and for browser 3) Google Chrome 123.0.6312.105 (edited)

1) Once you click on your e-mail/password account you will be logged in to our testing account. It allows to try out all app features and it's available even for Free account. Speaking of Cubbit, can you send us your bucket settings (versioning / locking?) Thanks

4:14 PM

One more question. Do you have E2E encryption enabled?

I see this

4:21 PM

Tom

One more question. Do you have E2E encryption enabled?

No I haven't

4:23 PM

So is possible that files that I'm uploading are stored on your testing account? I don't understand where files are stored

Riccardo Bellanova

So is possible that files that I'm uploading are stored on your testing account? I don't understand where files are stored

It's likely that they're stored in the testing account, as selected account is green. You can check currently selected account in the Drawer menu (top left, hamburger icon).

4:40 PM

You might need to add your Cubbit account using + icon:

4:42 PM

On each platform you need to configure your accounts separately, but you can simplify it using import/export options.

mmm ok I got it.. but I have to do this for both web and application

8:18 PM

separatly I mean

We don't synchronize external account credentials, because it's too much of a responsibility which we're not ready to deal with. User needs to setup credentials manually, but to ease this process we've introduced import/export JSON format. (edited)

Ok.. btw I'm trying to upload a file of about ~800MB and it goes quickly in error:

from web drag and drop: Invalid argument(S): invalid array lenght
from web "+" button: Null check operator used on a null value
- from linux app drag and drop: Null check operator used on a null value
from linux app "+" button: "Preparing to upload files window " stuck

Tom

We don't synchronize external account credentials, because it's too much of a responsibility which we're not ready to deal with. User needs to setup credentials manually, but to ease this process we've introduced import/export JSON format. (edited)

Ok ok I understand, now I'm using my s3 space

Riccardo Bellanova

Ok.. btw I'm trying to upload a file of about ~800MB and it goes quickly in error:

from web drag and drop: Invalid argument(S): invalid array lenght
from web "+" button: Null check operator used on a null value
- from linux app drag and drop: Null check operator used on a null value
from linux app "+" button: "Preparing to upload files window " stuck

That's Cubbit S3, right?

yes

Riccardo Bellanova

Ok.. btw I'm trying to upload a file of about ~800MB and it goes quickly in error:

from web drag and drop: Invalid argument(S): invalid array lenght
from web "+" button: Null check operator used on a null value
- from linux app drag and drop: Null check operator used on a null value
from linux app "+" button: "Preparing to upload files window " stuck

That's not what I am finding on Web for Cubbit S3. Can you try force refresh: Ctrl+Shift+R and try again?

Riccardo Bellanova

Ok.. btw I'm trying to upload a file of about ~800MB and it goes quickly in error:

from web drag and drop: Invalid argument(S): invalid array lenght
from web "+" button: Null check operator used on a null value
- from linux app drag and drop: Null check operator used on a null value
from linux app "+" button: "Preparing to upload files window " stuck

Speaking of Flatpak, the 1.8.2 is pending release and will be available in a few hours at max: https://github.com/flathub/io.kapsa.drive/pull/57 I would appreciate if you could try again on 1.8.2 and if it doesn't work for some reason then I will escalate that. (edited)

Update to 1.8.2 by tomekit · Pull Request #57 · flathub/io.kapsa.dr...

Tom

That's not what I am finding on Web for Cubbit S3. Can you try force refresh: Ctrl+Shift+R and try again?

I have the same errors from both ways.. Lets' try add s3 credentials specify region

8:40 PM

no..same errors

Tom

Speaking of Flatpak, the 1.8.2 is pending release and will be available in a few hours at max: https://github.com/flathub/io.kapsa.drive/pull/57 I would appreciate if you could try again on 1.8.2 and if it doesn't work for some reason then I will escalate that. (edited)

ok

Hello Tom, I tried with last version, but I have the same errors

Riccardo Bellanova

Ok.. btw I'm trying to upload a file of about ~800MB and it goes quickly in error:

from web drag and drop: Invalid argument(S): invalid array lenght
from web "+" button: Null check operator used on a null value
- from linux app drag and drop: Null check operator used on a null value
from linux app "+" button: "Preparing to upload files window " stuck

Speaking of Linux, I am testing the 1.8.2 release from Flathub. My host system is Ubuntu 23.10. I've connected to Cubbit S3 with versioning enabled. Both drag&drop from system file manager or by clicking Upload file works just fine. I've then tried to start app using same system as you (Mint 20.3), but I am actually failing to start the app. flatpak run io.kapsa.drive returns some issues related to libsecret and couple other ones. I believe that issues that you experience might be connected to Mint OS file manager. Can you make sure that zenity is installed on your OS? Can you try running: flatpak run io.kapsa.drive and let me know what errors/warnings you get, so I can understand which of them are "start blockers" and which of them are more like warning/info.

10:19 AM

I've also have no issues with drag&drop upload and standard file upload picker using Chrome Version 123.0.6312.58 (Official Build) (64-bit) or any other browser really. For both Web and Mint, can you please go to app Logs and see if there is anything interesting there?

I have found a bug. If you create a sync and set it up and then want to create another sync and click on the plus again, the settings from the last sync are still stored. After creating the sync, the form is not reset.

11:38 AM

A design issue, when you create a new folder on the sync windows to select a destination path. Folder test was created.

Malte

I have found a bug. If you create a sync and set it up and then want to create another sync and click on the plus again, the settings from the last sync are still stored. After creating the sync, the form is not reset.

We'll have it resolved. Thanks

Malte

A design issue, when you create a new folder on the sync windows to select a destination path. Folder test was created.

What's the issue here? Folder was created. Would you expect folder elsewhere in this view?

Tom

Speaking of Linux, I am testing the 1.8.2 release from Flathub. My host system is Ubuntu 23.10. I've connected to Cubbit S3 with versioning enabled. Both drag&drop from system file manager or by clicking Upload file works just fine. I've then tried to start app using same system as you (Mint 20.3), but I am actually failing to start the app. flatpak run io.kapsa.drive returns some issues related to libsecret and couple other ones. I believe that issues that you experience might be connected to Mint OS file manager. Can you make sure that zenity is installed on your OS? Can you try running: flatpak run io.kapsa.drive and let me know what errors/warnings you get, so I can understand which of them are "start blockers" and which of them are more like warning/info.

12:04 PM

I have nemo as file explorer (linux mint cinnamon)

12:04 PM

Have you tried with big files?

Riccardo Bellanova

Click to see attachment 🖼️

It seems that I need to resolve keyring issues, so I can test app on the Linux Mint myself. Did you have to setup Passwords & Keys / keyring on your Mint specifically in order to run S3Drive? Perhaps is it something you've done in the past before using S3Drive?

this is the log after drag & drop (edited)

Tom

It seems that I need to resolve keyring issues, so I can test app on the Linux Mint myself. Did you have to setup Passwords & Keys / keyring on your Mint specifically in order to run S3Drive? Perhaps is it something you've done in the past before using S3Drive?

Like what? I installed it with flatpak, so I just installed it and launched (edited)

Riccardo Bellanova

Have you tried with big files?

Not exactly, I will. Does it work for you if small file is used on both Web and Flatpak?

Tom

What's the issue here? Folder was created. Would you expect folder elsewhere in this view?

My thought was that the drawing before SSH also changes, that there is no interruption in the line, but is continuous to the Test folder

Malte

My thought was that the drawing before SSH also changes, that there is no interruption in the line, but is continuous to the Test folder

Thanks, there is an issue in the underlying library which we hope will be fixed eventually: https://github.com/embraceitmobile/animated_tree_view/issues/43 UPDATE: 5th July 2024. There is a potential solution we need to try: https://github.com/embraceitmobile/animated_tree_view/issues/43#issuecomment-2209475724 (edited)

1

Tom

Not exactly, I will. Does it work for you if small file is used on both Web and Flatpak?

application: drag and drop small files work, from "+" button always loading window stuck from web: small files OK

Riccardo Bellanova

Have you tried with big files?

I can confirm that at least drag&drop seem to be failing for ~900MB on Web, however when used "Upload file" it worked just fine. We will try to adress that. I am going to repeat those tests on Flatpak release drag&drop. (edited)

Riccardo Bellanova

application: drag and drop small files work, from "+" button always loading window stuck from web: small files OK

I see, so the + button issue is likely related to missing zenity or kdialog, please find other topic where used had this issue: https://discord.com/channels/1069654792902815845/1069654792902815848/1179417458185097247 Is it something you can install yourself? (edited)

zenity is already installed, I'm installing kdialog (edited)

Selected my personal music folder and videos folder in my home directory. Don't know why it looks like this with /run/user.... but it syncs the correct files

Malte

Selected my personal music folder and videos folder in my home directory. Don't know why it looks like this with /run/user.... but it syncs the correct files

That's interesting. Is that Flatpak? BTW. To not clutter this topic. If you have any feedback or comments like that one please either use #general , #off-topic or create #support item (for extended discussion). Thanks !

OK Yes it is

Riccardo Bellanova

zenity is already installed, I'm installing kdialog (edited)

I am wondering if file picker issue is now resolved on your end and whether installing kdialog actually helped?

Tom

I am wondering if file picker issue is now resolved on your end and whether installing kdialog actually helped?

Still have window loading stuck.. from + button

Hello... Now even from cleanup -> Multipart uploads I have the error Failed: Null check operator used on a null value

Riccardo Bellanova

Hello... Now even from cleanup -> Multipart uploads I have the error Failed: Null check operator used on a null value

Is that a Cubbit? Possibly some required fields are missing in the S3 response and functionality fails (without providing proper message), I am going to check that out.

Yes it's cubbit

Riccardo Bellanova

Yes it's cubbit

Cubbit doesn't provide this element according to specification: https://docs.aws.amazon.com/AmazonS3/latest/API/API_ListParts.html#AmazonS3-ListParts-response-NextPartNumberMarker We will provide a fix/workaround in a next couple days. (edited)

ListParts - Amazon Simple Storage Service

Lists the parts that have been uploaded for a specific multipart upload.

1

hello, now uploads with drag & drop work!!

1

Unfortunately no with "+" button, but with browser yes

Hello! I've this error when I'm trying to sync

Hi @Riccardo Bellanova, Can you please make sure you're logged in properly to your login/e-mail password account? Please go to profiles and if it says: "Managed account", instead of "Ultimate account" there is a chance you've been logged out in the meantime.

Tom

Hi @Riccardo Bellanova, Can you please make sure you're logged in properly to your login/e-mail password account? Please go to profiles and if it says: "Managed account", instead of "Ultimate account" there is a chance you've been logged out in the meantime.

I have this

You should have also your e-mail/password account. There is a + icon (top right) where you can add such account.

if I log in with user and password I have ultimate plan without my s3 storage, to have my s3 storage account I have to log in inserting access key etc.... what's wrong?

You have to login, and the switch back to your S3 using: "Manage profiles"

1:27 PM

You will then end up again on the Profiles page, where you can select your Cubbit account with a single click/tap.

oh ok! now it works

1

But sync two-way can't works without Rclone? (edited)

Riccardo Bellanova

But sync two-way can't works without Rclone? (edited)

Two-way sync is based on Rclone, but doesn't require Rclone installed. Do you face any issue with it?

Tom

Two-way sync is based on Rclone, but doesn't require Rclone installed. Do you face any issue with it?

I don't know, after an initial error, now is working!

3:42 PM

It seems there are no more app problems

Riccardo Bellanova

I don't know, after an initial error, now is working!

That's great, if by any chance you come across some error/issue, please send it over as text or screenshot, so we can investigate and improve the app. Thanks !

ok

3:44 PM

I've noticed that I still have some upload errors from browser

3:46 PM

and from app I can't upload from "+" button (always the stuck window loading)

3:47 PM

just to warn you.. btw.. great improvements

now I can start to use it better

Riccardo Bellanova

I've noticed that I still have some upload errors from browser

We've solved the web issue just now in the 10080802 build. I would appreciate if you could refresh your tab and try again.

Tom

We've solved the web issue just now in the 10080802 build. I would appreciate if you could refresh your tab and try again.

Now with "+" button works, error with drag and drop: Drag&drop exception: Invalid argument(s): Invalid array length

Riccardo Bellanova

Now with "+" button works, error with drag and drop: Drag&drop exception: Invalid argument(s): Invalid array length

Drag&drop on Web doesn't work for files >100MB if mutlipart upload is enabled, this needs fixing - https://s3drive.canny.io/feature-requests/p/fix-drag-and-drop-on-web-for-100mb-multipart-upload (edited)

Ok thanks

We've added couple things to our Flatpak build, not quite sure if these changes addresses the "+ button issue", but it's certainly worth trying.

1

Hello.. "+ button" still doesn't work

Hello! I just want to advise you that I upgraded my distro from linux mint 20.3 to 21.3, installed deb package... + button works and also the mount!

1

Riccardo Bellanova

Hello! I just want to advise you that I upgraded my distro from linux mint 20.3 to 21.3, installed deb package... + button works and also the mount!

That's amazing, thanks for letting us know !

1

Hello! congratulations for the upload improvements, it's amazing now! I'm able to upload very big files without problems! (from "+" button) but the percentage of loading is always blocked to 0% btw on linux app installed with deb package at the moment mounting is not working anymore (before yes), the mounted folder is empty now... and is possible add an icon to the linux application? is very ugly without it.. and (my personal request) is possible create the possibility to set a monocromatic icon for the bar?

That's great news. Do you mean that with multipart upload percentage reported in Transfers tab always stay 0%? Speaking on Linux app and mount issues, let's move our started discussion here: https://discord.com/channels/1069654792902815845/1253796440249991211 Even though there were some Cloudflare R2 specific issues on Windows, we've also applied similar improvements to Debian release. Can you please try newest build: https://github.com/s3drive/deb-app/releases/tag/1.9.3%2B1 and let me know? If the mount is still empty, can you additionally try clearing the cache (screenshot attached)? Yes we plan to release monochromatic icon https://s3drive.canny.io/feature-requests/p/implement-adaptive-monochromatic-icon (edited)

Yes I can't see the loading.. always stay 0% I tryed with that version but it's still not working even if I cleaned cache

Hi @Riccardo Bellanova, By any chance have you been using custom name for the profile? We've addressed empty mount bug (if custom name was used): https://github.com/s3drive/deb-app/releases/tag/1.9.4 as reported here: https://discord.com/channels/1069654792902815845/1258279431416320012/1258667066970476594

yes I changed It to "cubbit"

now it works

2

Can you add an icon to the .deb application?

Riccardo Bellanova

Can you add an icon to the .deb application?

I need to say we're quite struggling with that at the moment. We will add it eventually, but .deb release format wasn't particularly forgiving for us. (edited)

1

https://s3drive.canny.io/feature-requests/p/fix-deb-release-icon-missing

Fix .deb release icon missing | Feature Requests | S3Drive

1:29 PM

I am going to close this one for now. If you have any feature request or bug report please open a new one. Thanks!

1

Malte

A design issue, when you create a new folder on the sync windows to select a destination path. Folder test was created.

We've got a fix for that and will include it in a next release.

On Android, I am using Media Backup. It claimed that the camera folder was fully synced. I just used reset & match after noticing a few missing files in my bucket. Now it says that only 9589 out 12524 files are synced. I think it would make sense to harden the step which confirms that the upload was successful. Also, a feature request

- would be great to have the ability to verify uploaded files' integrity. Thanks & cheers!

yz

On Android, I am using Media Backup. It claimed that the camera folder was fully synced. I just used reset & match after noticing a few missing files in my bucket. Now it says that only 9589 out 12524 files are synced. I think it would make sense to harden the step which confirms that the upload was successful. Also, a feature request

- would be great to have the ability to verify uploaded files' integrity. Thanks & cheers!

I just found 1427 transfers which are in the error tab with DNS errors - like the backblaze URL didn't resolve. Maybe that's related? How does S3drive handle failures? I also just checked the sync feature. I guess a sync in mode 'sync' does indeed verify the uploads integrity. I'll check that in the following days.

yz

I just found 1427 transfers which are in the error tab with DNS errors - like the backblaze URL didn't resolve. Maybe that's related? How does S3drive handle failures? I also just checked the sync feature. I guess a sync in mode 'sync' does indeed verify the uploads integrity. I'll check that in the following days.

Once we get HTTP 200 OK response from an S3 endpoint or non-error response from an Rclone endpoint we assume it has succeeded and assume that this particular media ended up on the receiving S3. If upload failed it will get retried during next iteration/execution for Media upload (e.g. when it will process items in the queue, by the end it will check if any of them needs to be reuploaded. This also may happen on app start or if you take new photo [and background upload is enabled]) There isn't any additional upload verification within Media Backup, but as you rightly point out Sync functionality has one, after upload it queries the file and confirms that it's been uploaded correctly. I am not exactly sure what has happened in your case, whether Backblaze returned 200 OK, but hasn't saved the asset or in fact there was a bug on our end. We will consider: a) Adding an additional "after upload" verification, b) Providing a process/functionality to do the bulk hash verification of what's uploaded and what's on the phone. S3 protocol stores MD5 hash that can be used. If encryption is used normally hashing would require full object scan/download, but luckily we've added hash support to Rclone encryption which is released in S3Drive as V2 (beta) and will be enabled by default once it lands in Rclone mainline branch (https://github.com/rclone/rclone/issues/7192), c) Adding request/response detailed log, so we could debug what hash happened and why it failed. (edited)

Rclone crypt improvements (envelope encryption, truncation protecti...

We're running S3Drive (GUI for S3 on desktop, mobile, web) and recently aligned with Rclone's encryption scheme for better interoperability and features like drive mount and Webdav that we ...